A conceptual analytics model for an outcome-driven quality management framework as part of professional healthcare education

BACKGROUND: Preparing the future health care professional workforce in a changing world is a significant undertaking. Educators and other decision makers look to evidence-based knowledge to improve quality of education. Analytics, the use of data to generate insights and support decisions, have been applied successfully across numerous application domains. Health care professional education is one area where great potential is yet to be realized. Previous research of Academic and Learning analytics has mainly focused on technical issues. The focus of this study relates to its practical implementation in the setting of health care education. OBJECTIVE: The aim of this study is to create a conceptual model for a deeper understanding of the synthesizing process, and transforming data into information to support educators’ decision making. METHODS: A deductive case study approach was applied to develop the conceptual model. RESULTS: The analytics loop works both in theory and in practice. The conceptual model encompasses the underlying data, the quality indicators, and decision support for educators. CONCLUSIONS: The model illustrates how a theory can be applied to a traditional data-driven analytics approach, and alongside the context- or need-driven analytics approach

Virtual patients design and its effect on clinical reasoning and student experience : a protocol for a randomised factorial multi-centre study

Background Virtual Patients (VPs) are web-based representations of realistic clinical cases. They are proposed as being an optimal method for teaching clinical reasoning skills. International standards exist which define precisely what constitutes a VP. There are multiple design possibilities for VPs, however there is little formal evidence to support individual design features. The purpose of this trial is to explore the effect of two different potentially important design features on clinical reasoning skills and the student experience. These are the branching case pathways (present or absent) and structured clinical reasoning feedback (present or absent). Methods/Design This is a multi-centre randomised 2x2 factorial design study evaluating two independent variables of VP design, branching (present or absent), and structured clinical reasoning feedback (present or absent).The study will be carried out in medical student volunteers in one year group from three university medical schools in the United Kingdom, Warwick, Keele and Birmingham. There are four core musculoskeletal topics. Each case can be designed in four different ways, equating to 16 VPs required for the research. Students will be randomised to four groups, completing the four VP topics in the same order, but with each group exposed to a different VP design sequentially. All students will be exposed to the four designs. Primary outcomes are performance for each case design in a standardized fifteen item clinical reasoning assessment, integrated into each VP, which is identical for each topic. Additionally a 15-item self-reported evaluation is completed for each VP, based on a widely used EViP tool. Student patterns of use of the VPs will be recorded. In one centre, formative clinical and examination performance will be recorded, along with a self reported pre and post-intervention reasoning score, the DTI. Our power calculations indicate a sample size of 112 is required for both primary outcomes

Development, implementation and pilot evaluation of a Web-based Virtual Patient Case Simulation environment – Web-SP

BACKGROUND: The Web-based Simulation of Patients (Web-SP) project was initiated in order to facilitate the use of realistic and interactive virtual patients (VP) in medicine and healthcare education. Web-SP focuses on moving beyond the technology savvy teachers, when integrating simulation-based education into health sciences curricula, by making the creation and use of virtual patients easier. The project strives to provide a common generic platform for design/creation, management, evaluation and sharing of web-based virtual patients. The aim of this study was to evaluate if it was possible to develop a web-based virtual patient case simulation environment where the entire case authoring process might be handled by teachers and which would be flexible enough to be used in different healthcare disciplines. RESULTS: The Web-SP system was constructed to support easy authoring, management and presentation of virtual patient cases. The case authoring environment was found to facilitate for teachers to create full-fledged patient cases without the assistance of computer specialists. Web-SP was successfully implemented at several universities by taking into account key factors such as cost, access, security, scalability and flexibility. Pilot evaluations in medical, dentistry and pharmacy courses shows that students regarded Web-SP as easy to use, engaging and to be of educational value. Cases adapted for all three disciplines were judged to be of significant educational value by the course leaders. CONCLUSION: The Web-SP system seems to fulfil the aim of providing a common generic platform for creation, management and evaluation of web-based virtual patient cases. The responses regarding the authoring environment indicated that the system might be user-friendly enough to appeal to a majority of the academic staff. In terms of implementation strengths, Web-SP seems to fulfil most needs from course directors and teachers from various educational institutions and disciplines. The system is currently in use or under implementation in several healthcare disciplines at more than ten universities worldwide. Future aims include structuring the exchange of cases between teachers and academic institutions by building a VP library function. We intend to follow up the positive results presented in this paper with other studies looking at the learning outcomes, critical thinking and patient management. Studying the potential of Web-SP as an assessment tool will also be performed. More information about Web-SP

Virtual patient simulation: what do students make of it? A focus group study

<p>Abstract</p> <p>Background</p> <p>The learners' perspectives on Virtual Patient Simulation systems (VPS) are quintessential to their successful development and implementation. Focus group interviews were conducted in order to explore the opinions of medical students on the educational use of a VPS, the Web-based Simulation of Patients application (Web-SP).</p> <p>Methods</p> <p>Two focus group interviews-each with 8 undergraduate students who had used Web-SP cases for learning and/or assessment as part of their Internal Medicine curriculum in 2007-were performed at the Faculty of Medicine of Universidad el Bosque (Bogota), in January 2008. The interviews were conducted in Spanish, transcribed by the main researcher and translated into English. The resulting transcripts were independently coded by two authors, who also performed the content analysis. Each coder analyzed the data separately, arriving to categories and themes, whose final form was reached after a consensus discussion.</p> <p>Results</p> <p>Eighteen categories were identified and clustered into five main themes: learning, teaching, assessment, authenticity and implementation. In agreement with the literature, clinical reasoning development is envisaged by students to be the main scope of VPS use; transferable skills, retention enhancement and the importance of making mistakes are other categories circumscribed to this theme. VPS should enjoy a broad use across clinical specialties and support learning of topics not seen during clinical rotations; they are thought to have a regulatory effect at individual level, helping the students to plan their learning. The participants believe that assessment with VPS should be relevant for their future clinical practice; it is deemed to be qualitatively different from regular exams and to increase student motivation. The VPS design and content, the localization of the socio-cultural context, the realism of the cases, as well as the presence and quality of feedback are intrinsic features contributing to VPS authenticity.</p> <p>Conclusions</p> <p>Five main themes were found to be associated with successful VPS use in medical curriculum: Learning, Teaching, Assessment, Authenticity and Implementation. Medical students perceive Virtual Patients as important learning and assessment tools, fostering clinical reasoning, in preparation for the future clinical practice as young doctors. However, a number of issues regarding VPS design, authenticity and implementation need to be fulfilled, in order to reach the potential educational goals of such applications.</p

An Interactive Internet-Based Continuing Education Course on Sexually Transmitted Diseases for Physicians and Midwives in Peru

Clinicians in developing countries have had limited access to continuing education (CE) outside major cities, and CE strategies have had limited impact on sustainable change in performance. New educational tools could improve CE accessibility and effectiveness.The objective of this study was to evaluate an interactive Internet-based CE course on Sexually Transmitted Diseases (STDs) management for clinicians in Peru. Participants included physicians and midwives in private practice drawn from a census of 10 Peruvian cities. The CE included a three-hour workshop for improving Internet skills, followed by a 22-hour online course on STD-syndrome-management, with subsequent educational support. The course used case-based clinical vignettes tailored to local STD problems. Knowledge and reported practices on STD management were assessed before, immediately after and at four months after completion of the course. Statistical analysis included parametric tests-linear regression multivariate analysis, paired t-test and repeated measures ANOVA using SPSS 14.0. Of 1,071 eligible clinicians, 510 agreed to participate, as did an additional 132 public sector clinicians. Of these 642 participants, 619 (96.4%) completed the course, and 596 (96.3%) took the four-month follow-up evaluation. Physician and midwife scores improved from 64.2% correct answers on the pre-test to 77.9% correct on the four-month follow-up test (p<0.001). Most participants (95%) found the online course useful for their work needs. Self reported STD management practices did not change.Among physicians and midwives in Peru, an Internet-based CE course was feasible, acceptable with high participation rates, and led to sustained improvement in knowledge at four months. Further studies are needed to test it as a model for improving the training of physicians, midwives, and other health care providers

Offline and computer-based eLearning interventions for medical students' education

This is the protocol for a review and there is no abstract. The objectives are as follows: The primary objective of this review is to assess the effects of offline, computer-based eLearning compared with 'traditional' learning and other types of eLearning interventions for medical students' knowledge as well as changes in skills and attitude towards the intervention. Additionally, as secondary objectives, this review will assess the economic impact (cost-benefit, cost-utility or cost-effectiveness), unintended adverse effects, and medical students' satisfaction with using offline and computer-based educational interventions